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A. Cacciuto, E. Marinari 
Dipartimento di Fisica and Infn, Universitd di Cagliari 
Via Ospedale 72, 09100 Cagliari (Italy) 

G. Parisi 

Dipartimento di Fisica and Infn, Universitd di Roma La Sapienza 
P. A. Moro 2, 00185 Roma (Italy) 
(February 1, 2008) 

We use a constrained Monte Carlo technique to analyze ultrametric features of a 4 dimensional 
Edwards- Anderson spin glass with quenched couplings J = ±1. We find that in the large volume 
' limit an ultrametric structure emerges quite clearly in the overlap of typical equilibrium configura- 



tions. 



The hierarchical solution Q| of mean field spin glasses 

■ introduces a large number of new features. For 
\ T < TsG: m the broken phase, there are many stable 

£SJ ■ equilibrium states, not related by a simple symmetry 
group (like Z 2 in the normal Ising model). These states 
• exhibit an ultrametric structure: their distance satis- 
fies an inequality stronger than the triangular inequal- 
\^ ■ ity dx t 3 < di t 2 + d,2 t 3, the ultrametric inequality, stating 
1 — I | that di.3 < max(di j2 , ^2,3)- The existence of a phase 
OO ■ transition even in non-zero magnetic field (de Almeida- 
Thouless line) and of a complex dynamics, with aging 
phenomena, are other crucial features of this picture. 

The question of main interest is how many of such 
remarkable and new features survive the descent to fi- 
nite dimension. Mean field is in the case of usual, non- 
disordered systems, giving very good hints about the fi- 
nite dimensional case, but what about systems which of- 
fer such a series of completely new phenomena? In the 
last period much activity has been devoted to try and 

■ clarify this problem. As in many murky situations Monte 
. £h ! Carlo simulations are playing an important role |s| . Com- 
puting corrections to the field theory of the problem is 
also a difficult task, but progresses are being obtained 
j|. Here in the following we will select the problem of 
ultrametricity, and try to understand how this feature 
is modified when going from mean field to finite dimen- 
sional, realistic systems. 

The hierarchical solution of mean field spin glasses ad- 
mits a state structure endowed with an ultrametric dis- 
tance H (for a very good discussion of the problem, both 
introductory and going deep in the details of the subject, 
see |6|). Distances among states obey the ultrametric in- 
equality we have given before. Let us consider two spin 
configurations representative of two given states [0 . One 
can define the squared distance of two spin configurations 
as 
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where q a> p = -k J2i=i a f a i ^ s the overlap of the two con- 
figurations C a and Cp. Such d 2 takes the value when 
the mutual overlap is exactly q^A (the overlap of two con- 
figurations in the same state, i.e. the maximum allowed 
overlap), and the value 1 when the overlap is —qEA- This 
is the distance we will always have in mind in this note. 

The main result one obtains in mean field concerns the 
disorder averaged probability distribution for the prob- 
ability distribution of three overlaps. We consider three 
equilibrium configurations, 1, 2 and 3 of the spin sys- 
tems (interacting by the same given realization of the 
quenched couplings). 91,2, 92,3 and 91,3 are the mutual 
overlaps. By using the formalism of replica symmetry 
breaking one finds || that 

Pj(qi,2, 92,3, 91,3) 
= 2 P (H, 2)^(91, 2)%i, 2 - 92,3)^(91,2 - 91,3) 

+ {7^(91, 2)^(92, 3)0(91, 2 - 92,3)5(92,3 - 91,3) 

+ two permutations} , (2) 

where x(q) = J Q 9 P(q')dq' gives the weight of equilateral 
triangles (the other three terms represent triangles with 
the two equal edges longer than the different one). 

Further work on the ultrametric features of mean field 
solution [U has clarified the robustness of the ultrametric 
behavior. Numerical work on the subject is contained in 
references |9|Jl0t|. 

We want to understand what happen in the case of 
finite dimensional systems. It is clear that the problem 
is a difficult one: finite size effects are known to be severe, 
and the use of a scaling analysis is mandatory. 

We have used a constrained Monte Carlo procedure. 
For each realization of the quenched disordered couplings 
we have considered three configurations of the spin vari- 
ables, say C a , Cp and C 7 . We have fixed the distance of 
C a from Cp and of Cp from C 7 i.e. we have kept fixed to 
a constant value the overlaps q a ^ = 9^2 and qp. 7 = 92,3. 
A sensible choice of 91^ and 52,3 is crucial for the method 
to give useful results. The values 91,2 and 92,3 have been 
kept constant by forbidding spin updates that bring the 
overlap q a _p out of the range 91,2 ±e or the overlap qp^ 
out of the range 92,3 ±e. For all the simulations discussed 
in this note we have used e = 0.04. A systematic study of 
the choice of an optimal value for e is contained in |Tl] ]. 

By using this procedure we are restricting the phase 
space: our numerical simulations do not investigate the 
equilibrium properties of the full model, but only the sec- 
tor where in a triple of states two distance are fixed. To 
make the procedure consistent 9^2 and 92,3 have to be 
chosen in the support of the P{q) of the full model. A 
good choice of the constrained value will make the ultra- 
metric bound very different from the triangular bound, 
making the difference among the two phase space struc- 
ture as clear as possible. 
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We have studied the 4 dimensional Edwards- Anderson 
model, with quenched couplings J = ±1 with proba- 
bility \. The Hamiltonian H = ~Ylii j a i^ij a i contains 
a sum over first neighbors. We have chosen the 4d (as 
opposite to 3d) case because here we have a better un- 
derstanding of the critical behavior [jl(],|j (d = 4 is farer 
from the lower critical dimension, and the critical behav- 
ior is clearer). We have been working at T = 1.4, i.e. 
T ~ 0.7T C , where we are already in the broken phase and 
the P(q) has a clear non-trivial structure, but we are 
still able to completely thermalize the non-constrained 
system, at least on small lattices |ll]] . 

We have used lattices of volume V = L 4 with L = 3, 
4, 5, 6, 7 and 8. L = 8 was the maximum lattice size we 
felt sure we were able to thermalize. We have averaged 
the Pj (q) over different realizations of the quenched dis- 
ordered couplings J; in both the numerical experiments 
we will describe in the following the number of samples 
Nj has been a maximum of 2000 for the smallest lattice 
(L = 3) and a minimum of 100 for the largest lattice, 
L = 8 (with intermediate Nj values for the intermediate 
lattice sizes). 

We will give more details about the thermalization of 
the samples, that is for this kind of numerical experi- 
ment a crucial issue. We have been very careful about 
this point, and all the data we present here have passed 
detailed thermalization tests For all lattice size we 
have used an annealing schedule; starting from a random 
configuration we have cooled the systems from T = 2.4 
down to T = 1.4 at steps AT = 0.1 (for the smaller L 
values) or 0.2 (for the larger ones). At each T value we 
have ran from 25000 sweeps (L = 3) to 80000 sweeps 
(L = 8). Once at T = 1.4, after the usual thermalization 
steps, we have ran from half a million (T = 3) to eight 
hundred thousand sweeps (L = 8) for measuring. 

Our main results have been obtained by fixing 

9q,/3 = qi,2 = <7/3,7 = \qEA = q , (3) 

where by qEA we mean the infinite volume values as esti- 
mated for example in ficfl (.54). That means we are fixing 
q = .21 for all the volume values we investigate. In this 
condition the triangular inequality obliges the measured 
q, the third side of the triangle, to obey 

7 

q > ~T<lE A , (4) 

5 

while an ultrametric distance would imply 

2 

q > ^ea ■ (5) 

It is clear that the two bounds are very different. Obvi- 
ously in both cases in the infinite volume limit the mea- 
sured q will be smaller than qEA- 

In fig. (|l|) the vertical line on the left, at q ~ —0.75, 
depicts the bound given from the triangular inequality. 
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The second vertical line, at q ~ .21, depicts the ultramet- 
ric bound, while the vertical line on the right, at qEA, is 
the upper bound for infinite volume. The probability 
distributions of the measured q value (the overlap among 
configuration C a and configuration Cp, see before) for 
the 6 L values, from L = 3 to L = 8. The L = 3 P(q) is 
the one with the smaller peak, farest on the right, that 
end last on the left: P(q) for increasing L values have 
higher peaks, and end more and more at q values close 
to zero. It is clear that already on small lattices the dis- 
tribution is far from the triangular bound. 

The probability for a measured distance q not to be 
ultrametric (i.e. one minus the normalized area S u of the 
P(q) integrated inside the ultrametric bound) decreases 
fast with the lattice size. On a L = 8 lattice half of 
the configurations are ultrametric (and indeed the big 
violation is from configurations with q > qEA, which we 
expect from normal Monte Carlo runs to disappear in the 
continuum limit). 

In fig. (||) we plot the value of the integral 

I L = J qm "\q(L) - q mm ) 2 P{q)dq 

+ [ (q(L)-q M Ax) 2 P(q)dq , (6) 
J Qmax 

in log-log scale. Here q mm = qi. 2 and q M AX = qEA- The 
lower points (1%) are for the case we are discussing here, 
the upper ones for the case where we fix q\^ ^ 92,3 (see 
later). The straight line is our very good best fit to a 
power behavior, that gives 

I L ~ (-.0001 ± .0005) + (0.76 ± 0.03)L- 2 - 21±0 - 04 . (7) 

The integral goes to zero in the infinite volume limit, 
as we would expect for an ultrametric structure. It is 
remarkable that the asymptotic value is estimated to be 
so close to zero, and that the estimated exponent is very 
close to the | one expects from the results of || . 

A few comments are in order. There are two different 
and important effects in fig. (Q). On the one side the 
number of configurations with large q (q > qEA°°) de- 
creases with increasing L. These are the kind of finite 
size effects that normally one studies. Such finite size 
effects are already known to be quite large in quenched 
disordered systems: even for the SK model it is quite 
difficult to get a good numerical determination of the 
position of the peak of P(q) in the infinite volume limit. 
We confirm that in our simulation. On the other side 
(q < 0) things are different. Already on a very small lat- 
tice very few configurations are allowed in the region that 
is allowed by the triangular inequality but ultrametrically 
forbidden. This region is systematically reduced when in- 
creasing the lattice size (it is basically halved when going 
from L = 3 to L = 8). 
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We have also fitted the position of the peak of P(q), 
Imax w ith an L-dependent power law. Our best fit is 
very good and gives 

q$ AX = (0.31 ± 0.09) + (0.85 ± 0.03)L~°' 59±015 , (8) 

with a value of q^AX J us ^ m the cen ter of the allowed 
ultrametric region. 

These results look very positive. Already on the lat- 
tice sizes one can equilibrate with a numerical simulation 
(in a sector of the phase space) that took a few months 
of workstation time one clearly sees the increasing dom- 
ination of ultrametric sample couples. Obviously we do 
not know if in the infinite volume limit there will be a 
completely ultrametric structure (we do not have a pri- 
ori reasons to be sure of that) or if ultrametricity will be 
realized on finite dimensional spin glasses only as a dom- 
inance of states close to ultrametric behavior: certainly, 
we are showing here that the ultrametric sector of the 
phase space is very important. 

Maybe the most important problem we are detecting 
is the one of large finite size effects. That was already 
known, and we confirm it here: for example q^\ con- 
verges only very slowly to q^AX • 

Thermalization is a key problem. In a constrained dy- 
namics like the one we are using is very difficult to ascer- 
tain thermalization. The usual criterion of checking that 
the dynamical Pd(q) (i.e. the one where the overlap is 
defined from Unit!— ►«> <r(t)a(t + ti)) should coincide with 
the equal time P e (q) (where the overlap is from the evo- 
lution of two different systems, i.e. from <r(t)r(t)) is not 
useful here (since in our constrained Monte Carlo method 
we do not have an equivalent dynamical quantity Pd{q) 
to compare with). Also the symmetry a — > — a is not a 
good symmetry here, and the symmetry of P{q) cannot 
be used to check thermalization. Because of that we have 
tried to stay on the very safe side. In figure (||) we plot 
P(q) for L = 5 (100 samples) for the first, the second 
and the third third of the MC sweeps (after the anneal- 
ing schedule). The three curves are basically identical, 
making as confident that we are having no thermaliza- 
tion problems. 

We have also analyzed a different situation, in which 
we have set qi^ ^ 92,3- In this case we have used runs of 
length similar to the one of the previous case, a similar 
number of samples, same L values and T = 1.4. We have 
fixed qi y 2 = ^Qea and (72,3 = \qEA- In this case an ultra- 
metric behavior implies that in the infinite volume limit 
P(q) = S(q — jrqEA), centered in \qEA — 0.10. We report 
in fig. ([|) the P (q) for this situation. A power fit for the 
position of the peak in the infinite volume limit gives as 
a preferred value q^lx ~ (0-10 ± 0.03), right on the ul- 
trametric point. Also in this case we are getting a strong 
indication toward the presence of ultrametric features in 
the state space of finite dimensional spin glasses. 
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In fig. (||) we also plot the value of the integral I L for 
this second case (h)- Here q m in — 1m ax is the location 
where we expect a delta function to be built in the infinite 
volume limit, and the integral just goes from —1 to 1. 
The straight line is again the best fit to a power behavior, 
that gives 

I L ~ (-.000 ± .002) + (1.95 ± 0.08)L _1 - 95±0 04 . (9) 

Also here the integral seems to be going to zero in the 
infinite volume limit. 

We are grateful to Felix Ritort for sharing with us some 
ideas about this problem. We also thank Peter Young for 
an interesting conversation. 
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FIG. 1. P(q) of the free overlap measured in the course of 
our constrained Monte Carlo as a function of q, for L values 
going from 3 (lowest curve, ending on the left closest to q — 0) 
to L = 8 (highest curve, ending on the left farest from q = 0). 
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FIG. 2. The integral I L as a function of L, in double log 
scale. The lower points are for the case where we have fixed 
qi,2 = q2,3, the upper points where qi t 2 ^ <Z2,3 (see the text). 
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FIG. 3. The three curves (basically coinciding in the plot) 
are for P(q) in the first, the second and the last third of the 
run (after the annealing scheme described in the text), L = 5, 
100 samples. 
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FIG. 4. As in figure (|l]), but for gi.2 = \iea and 

92,3 = \lEA- 
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